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ABSTRACT 

Noting that successful comprehension, problem 
solving, and decision making are dependent upon activation and 
appropriate application of relevant schemata of existing knowledge, 
this report examines the practice of oversimplifying information in 
the content ar*as to make teaching and studying easier, and the 
dangers inherent in doing so. The report first develops principle 
contentions concerning well-structured domains of knowledge (WSDs) 
and ill-structured domains (ISDs), Schema theoretic knowledge 
representation and the problem of transfer and related research are 
also examined. The report then examines the pra^.ice of 
overgeneralizing in teaching, focusing on (1) * JL-structuredness of 
some content; (2) the use of case study; (3) the nonlinear and 
multidimensional arrangement of cases; (4) empirical dimensions for 
testing the theory (including results of a study of curriculum 
simplification); (5) suggestions to bring about a science of 
instructional sequencing, case selection, and case arrangement; (6) 
the role of visual-perceptual representations and adjunct aids in 
transfer; and (7) discovery learning in a well-structured domain. 
Concluding remarks suggest that the learning principles proposed in 
the report will make ill-structured material easier to teach and 
understandable for students, (Three pages of references and one page 
of footnotes are included,) (JC) 
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Abstract 

A theoretical orientation to learning and instruction in ill-structured knowledge domains is 
presented. The theory is especially concerned with the application of knowledge in new situations 
(knowledge transfer), rather than the mere reproduction of knowledge in the way that it was 
originally learned. It is argued that knowledge transfer in complex and ill-structured domains is 
centrally dependent upon "cognitive flexibility." According to the theory, greater flexibility in the 
representation of domain knowledge will result from approaches that promote highly interconnected 
rather than neatly compartmentalized or hierarchicalized mental representations; that represent 
knowledge in terms of multiple, rather than single, prototypes and analogies; that increase the 
emphasis on learning from cases, while qualifying and restricting the scope of application of abstract 
principles; and that rely upon situation-dependent schema assembly rather than the retrieval of a 
ngid, prepackaged schema. A nonlinear system of learning and instruction that promotes these 
requisite features of cognitive flexibility is presented. In the system, cases or examples in a conceptual 
"landscape" are criss-crossed in a variety of directions, along multiple dimensions. Empirical 
paradigms for testing the theory are presented, and positive results of preliminary experiments are 
discussed. Finally, issues of case selection and sequencing are addressed, and the possible role of 
visual-perceptual adjunct representations in making the management of complexity more tractable is 
highlighted. 
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KNOWLEDGE ACQUISITION FOR APPLICATION: 
COGNITIVE FLEXIBILITY AND TRANSFER 
IN COMPLEX CONTENT DOMAINS 



A fundamental tenet of all recent theories of comprehension, problem solving, and decision making 
is that success in such cognitive arenas depends on the activation and appropriate application of 
relevant preexisting knowledge. Despite the substantial agreement on this general claim, we know 
very little about the organization of background knowledge and the method of its application to the 
understanding of new situations when, because of a combination of the breadth, complexity, and 
irregularity of a content domain, formulating knowledge in that domain to explicitly prescribe its full 
range of uses is impossible. V/e call knowledge domains of this type ill-structured and contrast them 
with more routinizable knowledge domains that we refrr to as well-structured} What does one do 
when relevant prior knowledge is not already organized to fit a situation (as will frequently be true in 
ill-structured domains, by definition) and so must be assembled from different knowledge sources in 
memory? This is a problem of knowledge transfer. We address a crucial issue in transfer: How 
should knowledge be acquired and organized to facilitate a wide range of future applications? 

The principle contentions developed in this chapter are: 

1. that theories in the cognitive sciences have produced a far better understanding of cognitive 
process in well-structured domains (WSDs) than in ill-structured domains (ISDs); 

2. that theories appropriate for WSDs are in many ways inappropriate for ISDs-that, in fact, 
optimal conditions of learning and instruction in the two kinds of domains are opposite in 
several important respects; 

3. that one of the most serious problems with treating ISDs as if they were WSDs is an inability 
to establish a basis for knowledge transfer, for the application of preexisting knowledge to 
new situations; 

4. that transfer in ISDs is best promoted by knowledge representations that possess the 
following features: multiple interconnectedness between different aspects of domain 
knowledge, multidimensional or multiperspectival representation of examples/cases, and 
allowance for various forms of naturally occurring complexity and irregularity; 

5. that in order for knowledge structures to possess the characteristics described in 4, emphasis 
must shift from the retrieval of a precompiled schema to the assembly of a situation-sensitive 
schema from knowledge fragments--the features described in 4 and 5 are characteristics of 
what we call cognitive flexibility; 

6. that the best way to learn and instruct in order to attain the goal of cognitive flexibility in 
knowledge representation for future application is by a method of case-based presentations 
which treats a content domain as a landscape that is explored by "criss-crossing" it in many 
directions, by reexamining each case "site" in the vaiying contexts of different neighboring 
cases, and by using a variety of abstract dimensions for comparing cases. 

Our primary claim is that in situations where complete comprehension or solution paths are neither 
inherent in the task or its description (i.e., are not implicitly or explicitly prescribed), nor anticipatable 
in the natural course of earlier learning and concomitant knowledge representation (either by explicit 
mention or by generative rule), then the key factors affecting the success with which prior knowledge 
is used to improve performance in a new situation will be the flexibility with which the relevant prior 
knowledge is represented in memory, and the mastery or control the individual has over those flexible 
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representations (the ability to recombine elements of the representations, reorder the importance of 
elements in different contexts, and so on). 

When knowledge cannot be routinized, mechanized, or automatized, it must be flexibly controlled. 
And control is not solely a process issue, independent of content. Executive control strategies require 
flexible knowledge structures to operate upon. In turn, control over flexible representations will give 
an individual more control over a content domain; rather than monolithic prepackaged knowledge 
structures constraining an individual to apply knowledge in a fixed and limited manner, the individual 
controls the knowledge; that is, a great variety of nonp'edetermined ways to adapt knowledge to rhe 
task and content elements involved in the new situation are available. This paper presents a theory of 
learning and instruction, of knowledge representation and application, for the flexibility-based control 
that enables transfer. The goal of the program of research that we discuss is the validation of a set of 
basic principles and related instructional practices that will allow students to better apply the 
knowledge they acquire from formal schooling to new, real-world cases-knowledge that is built for 
use, not for imitative reproduction in artificial school or laboratory settings. 

Schema-Theoretic Knowledge Representation and the Problem of Transfer 

It is hard to imagine a more valued intellectual ability than that of independent thought-the ability to 
"think for yourself when applying the necessarily limited knowledge acquired in formal schooling 
and training to the wide variety of situations in which that knowledge is relevant--the ability to use 
one's knowledge flexibly and to efficiently adapt it to varying contexts. Of what value is knowledge if 
its potential for application is much more limited than the range of uses to which it needs to be put? 
Very little, most would agre*. 

Nevertheless, a class of very influential contemporary approaches to knowledge representation, 
schema, frame, and script theories (e.g., Rumelhart & Ortony, 1977; Schank & Abelson, 1977) have 
had four interrelated shortcomings related to the problem of transfer. (As we see later, many of the 
following criticisms also apply to another class of approaches to knowledge representation: prototype 
and exemplar theories; e.g., Rosch & Mervis, 1975). 

First, because these kinds of knowledge structures are frequently prepackaged (precompiled), they 
tend to be overly rigid. As a result, they provide very little opportunity for adaptation to diverse 
contexts of use. 

Second, these modes of representation tend to isolate or compartmentalize aspects of knowledge that, 
in use, need to be interconnected. Again, the result is a limited potential for transfer. 

Third, they have frequently treated complex subject matter as if it were simpler than it really was; 
complexities that transfer depends on have been artificially neatened. 

Fourth, they have often implicitly a'isumed that knowledge domains possess more regularity or 
consistency across cases of application than they actually do. 

These four characteristics of the recently predominant modes for representing knowledge, 
antithetical to the flexibility needed for wide application, are essentially simplifying assumptions: It is 
assumed that knowledge domains are simpler and more regular than they in fact are; these 
assumptions lead to representational approaches that are more rigid and compartmentalized than 
they ought to be. Historically, the assumptions of simplicity and regularity are strategically 
understandable and justifiable; Progress in new fields comes much more slowly without simplifying 
assumptions. And there has been considerable progress in cognitive science. However, when 
progress has been as slow as it has been on so important a topic as transfer, then it is time to drop 
those simplifying assumptions that are causing progress to be impeded. 2 
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The simplifying assumptions of cognitive science apply as well to dominant modes of education. 
Simplification of complex subject matter makes it easier for teachers to teach, for students to take 
notes and prepare for their tests, for test-givers to construct and grade tests, and for authors to write 
texts. The result is a massive "conspiracy of convenience." To take one example of the consequences 
of this tendency, Spiro, Feltovich, and Coulson (in preparation) have identified more than a dozen 
serious errors in the concepts held by a majority of medical students tested. Each of the errors was 
connected to a different kind of cognitive or educational oversimplification. 

The overall effect of the simplifying features of knowledge representation systems and instructional 
strategies mentioned previously is a leveling tendency, a tendency towards monolithic approaches. 
Understanding is seen as proceeding in essentially the same way across instances of the same topic. 
Our view is different: The conditions for applying old knowledge are subject to considerable 
variability, and that variability in turn requires flexibility of response. Monolithic representations of 
knowledge will too often leave their holders facing situations for which their rigid "plaster-casts" 
simply do not fit The result is the often heard complaint of students: "We weren't taught that." By 
this, they mean that they weren't taught exactly that They lack the ability to use their knowledge in 
new ways, the ability to think for themselves. Our research focuses on fostering the kinds of flexible 
knowledge representations that would free students and trainees from the limitations of having to use 
the information they receive in instruction in only that way in which it was originally instructed (rigid 
knowledge structures that need to be applied rigidly). 

To achieve this goal we systematically depart from the four interrelated simplifying assumptions of 
the schema-type theories that we identified earlier (which, again, are also common assumptions in 
schooling). 

• Rigid, monolithic, prepackaged knowledge representations are replaced by flexible 
representations in which fragments of knowledge are moved about and assembled to fit the 
needs of a given context of application. Instead of prepackaged schemata, purpose-sensitive 
situational schemata are constructed, thus allowing knowledge to be used in different ways 
on different occasions for different purposes. The emphasis is shifted from prepackaged' 
schemata to the ingredients for many potential schemata; schema selection is devalued in 
favor of schema assembly, storage of fixed knowledge is devalued in favor of the mobilization 
of potential knowledge. One cannot have a prepackaged schema for everything. 

• We replace highly compartmentalized knowledge representations with structures 
characterized by a high degree of interconnectedness. Appropriate compartmentalization of 
knowledge in one situation may not be appropriate in another. Multiple interconnectedness 
permits (a) situation-specific categorization, (b) multiple access routes to relevant case 
precedents in long-term memory from the details of new cases, and (c) the development of a 
reservoir of potential analogies when case precedents are less literally relevant. 

• Instead of inappropriate simplification, we work with complex subject matter (e.g., historical 
topics, military strategy, biomedical concepts), acknowledging and teaching towards the 
complexity inherent in them. (Later in this chapter we address the issue of how learners can 
be aided in managing difficult complexities.) And just as subject matter is frequently more 
complex than is realized, so, too, are the real cases to which knowledge about that subject 
matter has to be applied. Cases or examples must be studied as they really occur, in their 
natural contexts, not as stripped down "textbook examples" that conveniently illustrate some 
principle. The applicatioi of knowledge in new situations will be thwarted if the 
contingencies for application are more complex than the knowledge brought to bear. 



Spiro, Vispoel, Schmitz, Samarapungavan, & Boerger Knowledge Acquisition - 5 

• We relax the often unrealistic assumption of regularity, of routinizability, of well- 
structuredness--the assumption that subsets of individual cases (applications, examples) in a 
knowledge domain are sufficiently alike that they may be covered in common by a self- 
consistent system of general principles or rules. Thus, where schema-type theories tend to be 
overly general and to abstract away from individual cases that are classified in the same way, 
our approach sticks closer to the specific details and characteristics of individual cases. The 
consequences of treating ill-structured material as if it were well-structured are knowledge 
representations that are inapplicable in transfer situations or that produce inaccuracy. (Note 
that although complexity is highly related to irregularity, they are not the same thing. For 
example, the facade of the Old Executive Office Building next to the White House has a 
highly complex but regular structure. We work with domains that are complex and ill- 
structured.) 

A Note on Related Research 

Our approach has many connections to prominent thematic strands of current theoretical interest. 
However, the manner in which we instantiate these strands, especially the way they are configured in 
our overall approach, is novel. Therefore, because the main thing in common between what we do 
and the research of others involves overlap in subsets of the constituent themes emphasized rather 
than m the specifics of how those themes are applied and combined, we simply point to those 
thematic areas of overlap here: analogy (Carbonell, 1983; Gentner & Gentner, 1983; Gick & 
Holyoak, 1980, 1983; Rumelhart & Norman, 1981; Winston, 1983); learning from examples 
(Anderson, Kline, & Beasley, 1979; Carnine, 1980; Medin & Schaffer, 1978); reminding (Kolodner, 
1980; Ross, 1984; Schank, 1982); connectionism, parallel distributed systems, "society of mind" 
(McClelland & Rumelhart, 1985; Minsky, 1979; Waltz & Pollack, 1985); tutorial guiding (Collins & 
Stevens, 1983); constructive (J. Anderson, 1983; R. Anderson, 1977; Barsalou, in press; Bartlett, 
1932; Spiro, 1977, 1980a, 1983); cognitive complexity (Scott, Osgood, & Peterson, 3979; Streufert & 
Streufert, 1978); automatic versus controlled processing (Shiffrin & Schneider, 1977; Schneider & 
Shifinn, 1977); efficiency and cognitive economies in mental processes (Spiro, 1980b; Spiro & 
Esposito, 1981; Spiro, Erposito, & Vondruska, 1978); metacognition and learning to learn (Brown, 
Campione, & Day, 1981); perceptual and experiential aspects of conceptual memory (Bartlett, 1932; 
Spiro, 1983; Spiro, Crismore, & Turner, 1982); contextual encoding variability (Smith, Glenberg, & 
Bjork, 1978); linear separability (Medin & Schwanenfluegel, 1981); fluid task environments (Lenat, 
Hayes-Roth, & Klahr, 1983); structural analysis of content-area text (Britton & Black, 1985; Spiro & 
Taylor, in press). 

A good example of f. researcher whose work incorporates many of the same themes that we do is 
Barsalou. As we are, he is centrally concerned with contextual variability in conceptual structure, 
cognitive flexibility, and temporary concept construction under contextual constraint (Barsalou, in 
press). Even here though, the similarities are not as instructive as they might at first appear because 
of the difference in the kind of domains studied. Barsalou works with relatively low-level concepts 
and categories. There are many fundamental differences in both internal structure and the cognitive 
processes that must operate on that structure between concepts like "Bird. 1 !" and "Fruit" (or even 
"Places to Go On A Vacation"), on the one hand, and complex topics such as "20th-century History" 
or "Military Battles," on the other hand. There are also big differences between semantic memory 
tasks and the application of knowledge to real cases. All the problems with concepts and categories 
addressed by researchers like Barsalou (eg., graded structure; contextual variability; see also Medin 
& Smith, 1984; Smith & Medin, 1981) are so greatly exacerbated by dealing with knowledge 
application in real-world content domains that are made up of many concepts, that new issues of 
learning, representation, and transfer are inevitably introduced. The theoretical and empirical 
solutions corresponding to these issues produce a picture that overlaps very little between simple 
concepts and complex topical domains. 
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So, as promised earlier, because of the novel way we apply the preceding headlined themes, we move 
on to further discussion of the nature of our own approach. However, before proceeding we should 
explicitly acknowledge the most pervasive influence on our theoretical orientation and empirical 
procedures, the later work of Wittgenstein (1953). Our treatment of complex topical knowledge was 
inspired by prominent Wittgensteinian metaphors for knowledge organization and learning, especially 
the metaphor of the "criss-crossed landscape." TTiese and other debts to Wittgenstein (e.g., the 
reliance on approximate processes of family resemblance and the role of visual-perceptual forms of 
representation in attaining synoptic conceptual understandings) will be obvious in the following 
section and throughout the paper. 

Ill-structuredness, Learning from Cases, and the Instructional Metaphor of the 
"Criss-Crossed Landscape": A Prescription for Transfer 

Ill-structuredness 

In many domains, if one compares the features of large numbers of cases, a subset of the following 
conclusions may be drawn: 

• There are no rules or principles of sufficient generality to cover most of the cases, nor 
defining characteristics for determining the actions appropriate for a given case. 

• Hierarchical relations of dominance and subsumption are inverted from case to case. 

• Prototypes tend to often be misleading. 

• The same features assume different patterns of significance when placed in different 
contexts. 

• An explosion of higher order interactions among many relevant features introduces aspects 
of case novelty. 

It is such failures of general principles as these that we designate by the family label ill-structuredness. 
As will be seen later, this failure of general principles in ill-structured domains is directly related to 
the most sweeping recommendation that will emerge from our theoretical orientation: an emphasis 
in learning and instruction -upon multiplicity. Inste?d of using a single knowledge structure, 
prototype, analogy, and so on, multiple knowledge precedents will need to be applied to new 
situations (multiple schema*, several past cases, overlapping analogies). Under conditions of ill- 
structured complexity, single approaches provide insufficient coverage. 

"Ill-structured Complexity in the Domain 20th-century History." How would the events and 
phenomena of the 20th century be classified and presented in typical instruction? Some abstract 
system for organizing material would be developed. One likely approach would be to identify several 
themes of the 20th century to serve as organizing compartments (chapters, subheads), and then 
iridiviaual examples would be slotted where they seemed to best fit. "Moral Relativism" and 
"Knowledge Specialization" might both be discussed in a chapter on "Fragmentation as a Theme of 
20th-century Life"; a chapter about "Irrationality and Uncertainty in 20th-century Ideas" might 
refer to "Freud's Psychological Theory of Unconscious Control of Motivation and Behavior/* and 
"The Uncertainty Principle in Physics"; there might be a chapter on "Alienation" that would cite 
"Massive Bureaucracies Dwarfing the Individual" and "Mass Media Brainwashing"; and so oa 
Notice the implicit assumption of well-structuredness: Cases are taken as (often interchangeable) 
instances or illustrations of abstract themes. "The Advent of Nuclear Weapons" and "Existentialist 
Philosophy" both illustrate irrational aspects of the era, and it is the latter, more abstract, point that 
is taken as the important lesson. 
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However, think some more about the samples. Is not existentialist philosophy an example of 
alienation as well as a demonstration of the recent trend away from Cartesian views of rational man 7 
Are there not advantages u> grouping Freud's theories with the subliminal influences of mass media 
to bring out a point about how influences we are not aware of have come to increasingly control 20th- 
century life? In fact, any single organizational scheme for presenting examples from 20th-century 
history will suffer from two important shortcomings: (a) It will not be possible to present together all 
the cases that it would be instructive to present together, and cases that are not in the same physical 
vicinity in text will tend not to be closely connected in memory; and (b) much of the multifacetedness 
of the individual case will be lost as its significance is narrowed to the abstract j,oint that the case is 
presented as an illustration of. Similar problems would arise if some other system were used to 
represent the 20th-century cases. For example, if events were presented in chronological order, 
connections between temporally distant events would be likely to be missed. Similar consequences 
would ensue from a division along lines like politics, economics, and culture. Any single system for 
organizing material would not establish enough connections along enough dimensions to prepare one 
to deal with the great varieties of discourse about the 20th century that a learner is likely to 
encounter. 

The Importance of Cases 

It is partly because of such ill-structuredness that classroom instruction in professional fields (e.g., 
medicine, business) is so often augmented by considerable case experience (and that instruction in 
basic, nonapplied fields of knowledge ought to be). Lectures and textbooks tend to stress 
generalizations, commonalities, and abstractions over cases. Such approaches are clearly very 
effective when cases tend to be pretty much alike in how they have to be analyzed and responded to 
(i.e., in well-structured domains). Unfortunately, it is too often true that such assumptions are 
unwarranted, and the greater convenience associated with the traditional pedagogies is negated if 
they are ineffective. 

How is successful performance possible in the absence of generalizability across cases? The answer is 
by focusing analysis and knowledge representation more at the level of the individual case (example, 
occasion of use. event, or other cognate terms) and by guided experience with large numbers of cases 
If cases come in many forms, one needs to see many cases in order to represent their varieties of 
contextual influences and configurations of features. In a well-structured domain, cases (examples, 
etc.) are luxuries, helpful in illustrating general principles and then discardable; the principles can 
stand for all their subsumed, interchangeable cases In ill-structured domains, crucial information 
tends to be uniquely contained in individual cases-examples are not just nice, they are necessary. 
Our approach to knowledge acquisition is highly case-based. 

The problem is compounded, however, by the fact that ill-structuredness has a limiting effect on case- 
based training as well as on the more abstract approaches- Just as there are no homogeneous systems 
of principles or rules that can be generally applied, there are no generally applicable prototype cases. 
Ill-structuredness means that there cannot be any recourse to homogeneity, to any single course of 
action across instances, whether it involves a single guiding principle, a single organizational scheme, 
or a single prototype case. (Of course, in relatively well-structured domains like "Trips to Fancy 
Restaurants," a single conceptual macrosystem can be very effective.) Real-world cases tend to 
possess a multifaceted complexity and thus need to be represented in lots of different ways in order 
to bring out those multiple facets. Then, instead of a single case being the basis for case-based 
cognitive processing, aspects of different cases need to be combined, and it is the resulting 
assemblages, made up of fragments of different cases, that underlie an important part of case-based 
reasoning. The reconstruction of knowledge requires that it first be <fcconstructed«flexibility in 
applying knowledge depends on both schemata (theories) and cases first being disassembled so that 
they may later be adaptively reassembled. (Of course, som<; integral, nondecomposed case 
information must also be retained for guidance in ecologically realisitic case assembly.) 
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Thus, two kinds of flexibility are needed in knowledge structures for ill-structured domains, each of 
which a a central feature of the mental representations we attempt to build: 

Each complex real-world case needs to be decomposed and represented along many partially 
overlapping dimensions (i.c, the same information must be represented in lots of different 
ways). 



1. 



2, Many connections must be drawn across the decomposed aspectual fragments of the cases in 
1, thus establishing many possible routes for future assembly and creating many potential 
analogies useful for understanding new cases or making new applications; it is for this reason 
that our instructional system emphasizes connections between apparently dissimilar cases 
(and aspects of cases)-connections among obviously similar cases are much more likely to be 
noticed without special training, and thus not cause transfer problems. 

Nonlinear and Multidimensional Arrangement of Cases 

An example of how the two preceding theoretical commitments imply instructional methodologies is 
the use in our program of rearrangements of case presentation sequences so that the same case occurs 
in the context of various other cases. This enables different features of the individual multifeceted 
cases to be highlighted, depending on the characteristics of the other cases they are juxtaposed to 
while simultaneously establishing multiple connections, including distant ones. 

The discussion of case rearrangement brings us to the dominant metaphor employed in our theory of 
flexible knowledge representation and case-based instruction. Following the lead of Wittgenstein 
(see, for example, the preface to the Philosophical Investigations), we think of an ill-structured 
knowledge domain as akin to a landscape. Landscapes are often complex and ill-structured. No two 
sites are exactly alike, yet all sites possess many (but not all) of the salient features of the total 
landscape. The same could be said of landscape regions made up of several sites. The best way to 
come to understand a given landscape is to explore it from many directions, to traverse it first this 
way and then that (preferably with a guide to highlight significant features). Our instructional system 
for presenting a complexly ill-structured "topical landscape" is analogous to physical landscape 
exploration, with different routes of traversing study-sites (cases) that are each analyzed from a 
number of thematic perspectives. 

The notion of "criss-crossing" from case to case in many directions, with many thematic dimensions 
serving as routes of traversal, is central to our theory. The treatment of an irregular and complex 
topic cannot be forced in any single direction without curtailing the potential for transfer. If the topic 
can be applied in many different ways, none of which follow in rule-bound manner from the others, 
then limiting oneself in acquisition to, say, a single point of view or a single system of classification, 
will produce a relatively closed system, instead of one that is open to context-dependent variability. 
By criss-crossing the complex topical landscape, the twin goals of highlighting multifacetedness and 
establishing multiple connections are attained. Also, awareness of variability and irregularity is 
heightened, alternative routes of traversal 0 f the topic's complexities are illustrated, multiple entry 
routes for later information retrieval are established, and the general skill of working around that 
particular landscape (domain-dependent processing skill) is developed. Information that will need to 
be used ma lot of different ways needs to be taught in lots of different ways. Real cases (events, uses, 
etc) have multiple slants, and, because the goal of widespread transfer must be to be ready for 
anything that realistically is likely to arise, learning and instruction must anticipate using many of 
these many slants in the ways they tend to occur. 3 Criss-crossing a topic in many directions serves 
this purpose. It builds flexible knowledge. Accordingly, we construct nonlinear and multidimensional 
acquisition texts. 



ERIC 



10 



Spiro, Vispocl, Schmitz, Samarapungavan, & Boerger 



Knowledge Acquisition - 9 



Empirical Paradigms for Testing the Theory 

The acquisition phase of a typical experiment involves presenting cases in an experimental condition 
that, m general, involves manipulations of acquisition texts that, by using the kind of landscape criss- 
crossing onentation we have discussed, promote awareness and representation of complexities, ill- 
structuredness, and multiple potential connections across cases. Our control conditions tend to 
simplify, to present the same case material according to a single well-structured system 
( textbookization"), and to minimize case interconnectedness across the compartments of 
classification employed in the acquisition text 

Subjects always take at least two kinds of test, one that involves fairly literal understanding and 
reproductive recall of information from the acquisition text, and the other involving some sort of 
transfer (see following). Differences between experimental and control conditions are measured in 
terms of how much transfer they produce, and also in terms of the efTc-cncy with which information 
stored in memory produces the potential for transfer. We call the amount of transfer enabled by 
equivalent amounts of old knowledge in long-term memory a measure of transfer punch. 

There is a basic set of predictions in experiments testing the "Landscape Criss-Crossing" theory. 
Control conditions are expected to have mnemonic advantages that result in the rapid and accurate 
memonzability of the material presented in the acquisition phase of the experiments (compared to 
experimental condittons)~clear-cut "scaffoldings" are most effective for supporting reproductive, 
tact-retention-type memory (Anderson, Spiro, & Anderson, 1978; Ausubel, 1968). However, it is 
also expected that control conditions will produce overly inflexible, dosed down representations that 
will result m less transfer than the experimental conditions. (This should especially be so at later 
stages of practice, because the highly interconnected representations produced by the experimental 
manipulations probably require some "critical mass" of information before the assembly processes 
they depend on can begin to operate.) 

Results of preliminary tests of the theory. Data from two experiments using high school subjects 
have been analyzed. Both experiments produced results that conformed to our theoretical 
predictions. In the first experiment, 24 prominent and characteristic examples of 20th-century events 
and phenomena were selected. These cases included such developments as the advent of nuclear 
weaponry, the development of rapidly transmitted mass communications, and the loss of individuality 
caused by dealing with impersonal and massive bureaucracies. A paragraph was written about each 
case/examp!e. In the contfol condition, each of the paragraph-long case descriptions was placed in a 
chapter corresponding to one of three abstract themes it best illustrated (e.g., "Chaos, Uncertainty, 
and Irrationality," "Fragmentation ,of Old Unities," and "New Freedoms Mix With Powerful New 
Controls on the Individual"). This seductive nesting of examples under an abstract point or general 
principle was intended to paralir ; l the unidimensional treatment of cases and the abstraction-centered 
organization typical of textbooks and training manuals. In the experimental condition, after subjects 
read the control text, the same case-paragraphs (with minor modifications) were re-presented in a 
completely different context: Each case was paired with one from a different chapter. The intent was 
to bnng out the multifacetedness of the individual case and to demonstrate that the deceptively 
simple and neat structure of the control text is not an accurate reflection of the domain's actual 
organization. Both groups had the same amount of study time. 

The second experiment paralleled the first one, with the exception that the 20th-century cases were 
not re-paired in the experimental condition. Instead, the cases were presented in the same order as 
in the control condition but with individualized case-to-case linkages substituting for more abstract 
superordmate linkages of several cases. In other words, an experimental case-centered presentation 
scheme was contrasted with an abstraction-centered approach to the exact same material. 

These early studies did not provide ideal tests of the theory. It would have been desirable to allow 
longer study time to process the complex materials and, especially, to permit more re-pairings of the 
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cases, more enss-crosses of the topical landscape. Yet, even these first attempts, under far f>om 
satisfactoty conditions, produced the predicted results. ! n the first experiment, subjects in the 
textbooJazed control condition outscored those in the "criss-crossed" experimental condition on a 
reproductive memory test for the gist of the material as it was presented. The neat, well-structured 
scaffolding of the control condition provided better support for encoding and retrieving details than 
did the more complex scheme of the experimental condition. However, when the knowledge from 
the acquisition text had to be applied in some new way, performance in the experimental conditions 
of both experiments exceeded that of controls on six out of six transfer measures employed. 

The following six transfer tests were used in the two experiments (three in each): 

L and 2. Two different tests of integrative comprehension of new 20th-century texts that were only 
minimally related to the acquisition materials and that were drawn from books about the 
20th century (i.c, the kind of naturally occurring new texts that you would like instruction to 
transfer to). 

3. Comprehension of new texts constructed to link information on the topic of three of the 
cases from the acquisition text. 

4. An essay on a topic (art) that was not mentioned at all in the acquisition text (a picture of an 
abstract expressionist composition by Kandinsky was presented with the question "How is 
this painting typical or not of trends of the 20th century?"). 

5. A remote associations test requiring subjects to draw meaningful connections between 
randomly paired 20th-century events and phenomena that had not been previously paired in 
the acquisition phase. " 

6. A test requiring the selection of a correct description of a prominent (but unfamiliar to high 
schoolers) 20th-century icon or symbol. For example: "Giacometti's sculptures of walking 
men have been taken by many to be symbols of the 20th-century's • Existential Man • Were 
these walking men portrayed as (a) excruciatingly thin or (b) grotesquely fat?" Notice how 
this question has a correct answer (they were thin; and these sculptures have actually be n 
chosen to represent existentialist aspects of the modern condition, for exanj le, on the cover 
of Barrett s famous book on that topic, Irrational Man); note as well that it is possible to 
develop chains of reasoning that allow that answer to be figured out. but that there is no 
single, determinate path to that answer. 

These preliminary results suggest that there is a fundamental choice in methods of learning and 
ins ruction. Conventional methods seem to produce superiority when measured by conventional 
tests that stress reproductive, fact-retention types of memory. The methods developed from 
landscape Cnss-Crossing Theory are not as successful at producing mindless, imitative recall 
However, if one agrees that the goal of learning and instruction should be the acquisition of 
generative knowledge with wide application in novel but partially related contexts, then it would seem 
that methods like ours are far preferable to the conventional ones. 

Toward a Science oflnstructional Sequencing, Case Selection, and Case 
Arrangement 

There is no science of instruction from cases. The best we have are occasional useful 
recommendations (eg., Collins & Stevens, 1983). Where case-bared instruction is practiced (mainly 
in professional schools and in some training programs), procedures tend to be haphazardly 
determined by the intuitions of curriculum planners. When there is a systematic basis for case 
selection, that basis is probably misguided: Cases tend to be picked when they neatly illustrate some 
instructional point that is being covered. The same features that make such "textbook cares" 
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desirable for formal teaching (the way they form a clear-cut illustration of a topic that is being 
covered) are also likely to impede transfer, because in ill-structured domains true textbook cases are 
rare, and the intermediate, across-topic character of typical cases will be missed. 

As important, there is currently no systematic basis for case sequencing. Whatever effects there are 
of learning individual cases, cany-over learning from case to case can vary in its quality. Clearly, not 
all case arrangements are equivalent in the intercase learning they promote. Why not just allow for a 
random order of cases, as naturally occurs in the accrual of real-world experience? The answer is that 
you do not want to have to wait so long for experience to accrue. It is very possible that with the 
right system of case arrangement, learning from examples can be made far more rapid, accurate, and 
efficient than with haphazard presentation orders. The development of basic principles of case 
sequencing could substantially shorten the acquisition time and number of cases needed to support 
widespread transfer. 

Well- to ill-structured versus ill- to well-structured sequences. Part of conventional wisdom is that 
you start from the simple and then work toward the more complex (Glaser, 1984). In the terms of 
this paper, this would translate into a recommendation to first present material according to some 
well-structured abstr^t organizations, followed by the later introduction of complexities and 
irregularities. There are two dangers in this approach. First, it may inculcate a false impression that 
the domain is fundamentally simple and well-structured. Second, it may result in initial 
representations that are so neatly self-contained that they rigidly resist the complicated restructurings 
necessary to mirror the irregular contours of the domain. The problem with starting with an ill- 
structured presentation, on the other hand, is that it may be unrealistic to expect that subjects will be 
able to deal with complexity in material they are not sufficiently familiar with-the ingredients for 
flexible idea combination have to be established in memory before such combinatorial play can 
operate. 

These two instructional orders for teaching the same material can be contrasted with a third 
approach, an intermediate degree of well-structuredness of initial presentations. We expect this to be 
the most effective in promoting transfer, because it is not subject in extreme degree to the problems 
that result from having one of the two approaches dominate early instruction. A mixture of well- and 
ill-structuredness in the early stages of learning should allow sufficient prerequisite material to 
become well learned prior to operating in a complicated fashion on that material, and at the same 
time avoid the establishment of an overly rigid representation that would be difficult to dislodge. 

Before proceeding, it is veiy important to note that although we entertain different options for 
instructional sequencing, our position on the goals of learning is unequivocal. An advanced stage of 
knowledge acquisition will always be reached where learning criteria should no longer involve the 
demonstration of a superficial familiarity with subject matter and the memorization of some 
definitions and facts. Instead, at these more advanced stages, a learner should be required to get 
ideas right (even if that is hard to do) and to be able to appropriately apply those ideas (even if there 
are no simple formulas that they can memorize for doing so). If extra difficulty and confusion are the 
price of this shift in criteria, that is unfortunate but not an excuse for oversimplifying instruction. 
Wyas must be found to reduce the difficulties of the learner as much as possible without sacrificing 
the integrity of the subject matter being learned. 

Altorithms for case-to-case sequencing for transfer. What is the most efficacious ordering of cases 
to produce knowledge representations that maximize transfer (i.e., structures that are multiply 
interconnected along multiple dimensions)? It should first be noted that the many available 
discourse or text analysis schemes provide little guidance here. Successive cases are unlike successive 
parts of a text in that each case is an integral entity, rather than a continuation of the preceding case. 
In this sense, each case is like a new text. Thus, structural analysis models employing, say, linear 
cohesion principles are inappropriate for analyzing intercase structure. Instead, we argue that several 
strands of thematic interconnectedness between cases must be considered in evaluating across-case 
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structure. The metaphor of the "line* of development is then superceded by such others as 
"multistranded weaves," by the degree of overlap of many thematic elements (Wittgenstein, 1953). 

Our starting point for identifying optimal case-arrangement algorithms involves the notion of 
intermediately related cases, oipartial overlap across cases. We believe that it is important to neither 
group the cases that are most alike (and thereby promote the formation of spurious generalizations), 
nor to group cases in a way that maximally highlights their differences (thereby causing those 
regularities that do exist to be missed). Rather, we believe once again, as with case selection, that an 
intermediate course is to be preferred. We first seek a balance between continuity and discontinuity; 
some thematic features would overlap across adjacent cases and some would not; and which features 
overlap across cases would vary from one pair of cases to the next. Because ill-structured domains do 
not, by definition, permit single (or even small numbers of) connecting threads to run continuously 
through large numbers of successive cases, the notion of intermediateness of connection is intended 
as a first approximation to an alternative metric of strength of connection: "woven" 
interconnectedness. In this view, strength of connection derives from the partial overlapping of many 
different strands of connectedness across cases, rather than from any single strand running through 
large numbers of the cases (Wittgenstein, 1953). 

By comparing the overlap of thematic features for each adjacently presented case, an index can t>e 
calculated of the extent to which cases will appear to be relatively similar (and thus expendable- 
abstraction away from the cases would be thought to be possible) or dissimilar (in which case 
attempts at abstractive generalization would be perceived as futile). This is the first part of a "Partial 
Overlap Index." According to our theory, this Index should optimally have a value between its 
mathematically derivable maximum and minimum. The second part of the Partial Overlap Index xi 
calculated at a higher level of abstraction by looking at the relationships between the adjacent overlap 
relationships; successive case pairs should have an intermediate degree of overlap in the specific 
thematic features that they share (e.g., perhaps half of the overlapping themes for Cases 1 and 2 
should be overlapping themes for Cases 2 and 3). The highest values of the Index will be attained 
when both individual case information and abstract perspectives retain their viability, but without 
either achieving dominance-they both add something, but neither can supplant the other. 

Intermediate values on these two components of the Partial Overlap Index will allow important 
information about individual cases to be maintained and some partial abstractions to be formed. By 
maximizing the joint function of case uniqueness and abstractability away from cases (that is by treating 
cases as separate but overlapping), the best of both worlds is attained and the characteristics of 
complex real-world domains is most accurately mirrored. 

Perhaps more importantly, high values of the Index (i.e., intermediate degrees of overlap) should 
produce mental representations that maximize the potential paths for going from case to case in 
trying to assemble an appropriate set of precedents from prior knowledge to most closely fit the 
needs for processing some new case in the future. Because transfer/application in domains that lack 
rules or general principles of wide application is dependent on such situational^ dependent adaptive 
assembly processes, intermediate degrees of adjacent case overlap should be ideal. 

Another model of case sequencing is similar in many respects to the Partial Overlap model. It seeks 
primarily to highlight points of difficulty and confusion in a knowledge domain (which is, of course, 
where transfer is hardest to effect), especially those points where inappropriate abstraction is likely to 
mask useful case information. In this model, cases are juxtaposed in such a manner as to achieve a 
balance between calling attention to (a) differences in superficially similar cases (to avoid having the 
complexities of individual cases lost due to a reductive assimilation to their apparently common 
features), and (b) similarities between apparently common features), and (b) similarities between 
apparently dissimilar cases (to avoid overly separating the mental representations of cases that may 
jointly figure as precedents for the analysis of some future case or that may be usable as analogies, 
one for the other). 
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Learning as a cycle of successive "mutual bootstraps" between case knowledge and abstract domain 
knowledge. Implicit in the ideal, discussed earlier, of intermediate degrees of overlap between cases 
is the value of maintaining a balance between cases considered as unique and to be subjected to close 
analysis, on the one hand, and systems for representing the partial abstractions that characterize the 
across-case domain, on the other hand. This suggests another approach to sequencing: A cyclical 
alternation between abstraction-centered presentations, in which cases illustrate or concretize the 
abstractions, and case-centered presentations, in which the same abstractions are now used in 
combined form to describe the cases. So, for example, the abstract theme of Fragmentation in the 
20th century, illustrated by such cases as "Increases in Specialization" and "Multiple Influences fiom 
Media Exposure" in an abstraction-centered approach, would alternately be treated as an attribute, 
as part of the adjectival descriptor vocabulary for characterizing individual cases in a case-centered 
approach (Le., "fragmentation" is a feature of the phenomenon of "Increasing Specialization," rather 
than the latter merely illustrating the former). 

Each of these two kinds of systems should be able to help develop the other (hence the use of the 
expression, "mutual bootstraps"). As knowledge grows about how the complexities of individual 
cases are structured, that information should be useful in forming better abstract representational 
schemes for the domain that is the union of those cases. In other words, the more you know about 
cases in a domain, the better should be your systems for representing information about the domain 
that is itself, of course, constituted by those cases. At the same time, knowledge advances at the level 
of the entire domain should provide information useful in deriving insights for the development of 
better systems for representing the individual case (i.e., building a more adequate mathesis singularis). 
For example, the more you know about trends in tht relationships brtween cases in a domain, the 
more ideas you will have for how to study and represent an individual case. Therefore, in this 
instructional approach, new information about the overall, macrostructure of a domain feeds into a 
next cycle of studying how best to represent the complexities of individual cases already studied, and 
so on, continuing the cycle. Again, the conjecture is that the two systems may be able to iteratively 
serve as "mutual bootstraps," each improving the other. Because both systems contribute to novel 
transfr r/application, a self-perpetuating cycle of increasingly finer tuned improvements in the two 
systems would have obvious learning value. 

The Role of Visual-Perceptual Representations and Adjunct Aids in Transfer 

As is well known, the human perceptual system is very successful at representing large amounts of 
highly complex multivariate information at a glance (imagine all the information contained in an 
image of, say, a face), and storing that information in memory with great accuracy and durability. 
Studies have shown that hundreds of visual scenes presented in a short amount of time are 
recognized at very high levels of accuracy (Shepard, 1967; Standing, Conezio, & Haber, 1970). 
Furthermore, representations of visual information are rapidly comparable using an approximate, 
"family resemblance" type recognition process. So, the perceptual system is ideally suited to 
facilitating the representation of multidimensional complexity in individual cases, the subsequent 
recall of those cases, and the recognition of approximate family resemblances across cases. Because 
of these advantages, it may be beneficial to recode ill-structured representations into inputs 
acceptable for the perceptual system to operate upon, thereby reducing mnemonic overloads and 
fostering recognition-based assembly processes (Spiro & Myers, 1984). 

A means for effecting this perceptual recoding is available in the work on integral visual displays for 
observation of complex data. For example, we are exploring the use of one of these display systems, 
Chernoff Faces (Chernoff, 1973), in our own work. Case information is coded along multiple 
thematic dimensions, and a partly arbitrary code maps thematic features to different features of the 
visual display (i.e n different features of emotionally neutral Chernoff Faces; more important 
conceptual features are assigned to more salient facial features). Thus, large amounts of case 
information are presented in a single integrated picture that can be grasped at a glance. 
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Furthermore, the rapidity of perceptual processing means that large amounts of case information 
should be leamable in a much shorter time than would otherwise be possible. And a variety of 
resemblances across cases can be detected using the common human ability to recognize family 
resemblances across faces. 

Discovery Learning in Well-structured Domains 

The knowledge gained from studying ill-structured domains should be extendable to discovery 
learning in well-structured domains. From the perspective of the learner, well-structured domains 
are ill-structured until the principles of well-structuredness are discovered. Therefore, our principles 
of flexibly interconnected knowledge representation should increase the chances of noticing likely 
candidate systems of organization for the domain and should permit sufficient old information to still 
be available in memory to develop and test those candidate systems. 

Concluding Remarks 

We have discussed various issues in an area of cognition and instruction that are currently poorly 
understood: how to get people to independently go beyond their specifically instructed knowledge. 
In response to this gap in knowledge, we offered a theory of case-based learning for transfer in ill- 
structured knowledge domains and suggested methods of case-based instruction to produce flexible 
knowledge representations. 

From a practical point of view, the approaches we propose are not easy, and they may result in some 
increases in the time and effort required in initial instruction in a domain. However, we also expect 
that that investment will be more than justified by the fact that it will not be wasted instruction, 
limited in application to situations that happen to fit some narrow range of explicitly established 
preparedness. Wasted either because the instruction was too narrow in the case prototypes used, 
thus limiting applicability to reseniblant cases; or wasted because oversimplified general principles 
and rules were taught, accounting for too iittle of the relevant variability in the knowledge domain. 
Systems of instruction must be developed that produce knowledge that can be flexibly adapted to the 
wide variety of new situations to which it will need to be applied, even at some additional early cost. 

We know of no area oi human endeavor that lacks an ill-structured aspect. Success in ill-structured 
areas tends to come only with a considerable accumulation of actual case experience. Application of 
the learning principles we have proposed has the potential to take material that is either taught 
poorly or not taught at all (and thus left to the vagaries of haphazard acquisition from "experience" 
over long periods of time) and, for the first time, make that material directly instructable. 
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Footnotes 

lf rhesc terms receive further explication later in the chapter and are clarified in a more 
general manner by their use throughout the chapter-as "family resemblance" concepts, part of their 
definition can be no more than implicit in a complicated network of similarities and differences across 
uses (Wittgenstein, 1953). 

It should be noted that the relatively harsh tone taken toward schema-type theories 
throughout this chapter should be understood in the qualified sense in which it is intended. Rather 
than a blanket condemnation of these theories, we intend only to point out their shortcomings in 
enabling transfer in certain fairly common situations characterized by irregular complexity. Much of 
our earlier work has been in the schema theoiy tradition, and we are well aware of the importance of 
schema-type approaches. Again, our claims against those approaches are limited, namely to aspects 
of knowledge domains that are "ill-structured" (keeping in mind that even when well-structured 
knowledge is involved, the context of its application is frequently ill-structured). The next step after 
the kind of work that we describe in this chapter will be to combine schema-type representations with 
the more flexible kind we are developing, because the two approaches seem to be natural 
complements, possessing compensating strengths and weaknesses. Also, the feet that we emphasize 
the less studied ill-structured domains docs not imply that we discount the existence of domains with 
substantial regularity-they are just not the focus of our research. 

3 It is not necessaiy that criss-crosses of the landscape be exhaustive to produce generative 
structures. Rather, if enough of the topical landscape is portrayed, accurate anticipations of the 
structure of nonportrayed aspects will be possible. This can be seen by analogy to a situation in which 
one is presented with pictures of a man's fece only when he has expressions of anger or happiness; 
one would be able to fairly accurately anticipate what that person would look like if he were sad, 
grateful, sleepy, and so on. 
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ACTIVITIES 
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Activity 1.1 THE READING PROCESS 

Begin this activity by asking for a volunteer to read aloud as you write 
something on the board. Be sure to ask that j ust this volunteer reads aloud 
as the others read silently. 

• Start by writing "PRINCE ABDUL 11 on the board as the volunteer reads 
this aloud. Then pause for a second or two. 

• Continue by writing n MARRIES PRINCESS AMID" on the next line. Thsn 
pause for a second or two while the volunteer continues to read 
aloud* 



• Finally, write "POMP" on the last line. 

More than likely the reader-volunteer will have mispronounced "AMID" and 
realized this miscue after having read the last line. If this 1s not the 
case, ask any of the other participants if they had mispronounced "AMID" as 
they read silently. 

• Ask participants to discuss the thought processes they experienced 
as they read the headline. 

• Ask participants why the word "AMID 11 easily could be mispronounced. 

Elicit from the participants the Images they conjured up as they read the 
phrase "PRINCE ABDUL". Encourage them to recognize the role that background 
knowledge plays in making predictions during the reading process (see 
Chapter II of the Resource Guide ). 

Elicit from participants the expectation that, since the name of the prince is 
given first, the name of the princess 1 s what the reader might reasonably 
expect to follow the phrase "MARRIES PRINCESS". Point out that a proficient 
reader, upon discovering this likely miscue, would reread the initial phrase 
to correct the pronunciation of the word "AMID". 

• Ask participants to describe the thought processes they experienced 
in reading the headline. 

• Ask them to make generalizations regarding the reading process. 
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Point out that our knowledge of language contributes to our comprehension of 
text. For example, we correct our misreading In this Instance because the 
word "AMID", when mispronounced "AMEED", does not make linguistic sense in 
this context. 



Ask anothar volunteer to read aloud another headline as you write It on the 
board. Be sure to ask that just the volunteer read aloud as the others read 
silently. 



• Start by writing "BEGIN TO NEGOTIATE". 



• Continue writing on the next line "HITH KISSINGER". 



Finally, on the third line write "IN ISRAEL TODAY. 



More than likely the reader-volunteer will have mispronounced the word 
"BEGIN" and realized this mlscue after having read the last line aloud. If 
this Is not the case, ask any of the other participants If they have 
mispronounced "BEGIN" as they read silently. 



Ask participants to verbalize their thought processes as they read 
the headline. 



• Ask participants why they think the word "BEGIN" could be easily 
mispronounced. 



The contribution which background knowledge played In correcting the miscue 
should be emphasized here. Although linguistic sense would have It that the 
helping verb "begin" would be followed by an infinitive, our background 
knowledge would have it otherwise. Thus, the reader with some knowledge of 
Mldeastern politics and history would make the appropriate correction. 



Conclude this activity with the use of Overhead Transparency B: THE GOODMAN 
MODEL. Demonstrate the roles which background experience and linguistic 
knowledge play in the reading process. As you review the Smith-Burke 
adaptation of Goodman's model, be sure to point out that other models of the 
reading process exist. Hhlle this adaptation represents much of the current 
research on the reading process and serves as a foundation for the 
strategies recommended during the training here, teachers should be 
encouraged to read about concept-driven and Interaction theories of reading 
to obtain a richer understanding of research on the subject. Goodman ' s 
model serves merely as a basic framework for explaining activities presented 
in these modules. 
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Activity 1.2 THE READING PROCESS REVISITED 



Ask participants to translate the story, GLOOPY AND BUT, which appears In 
Horkshop Packet I (page I B.5>. Direct the participants to translate only 
the nonsense words Into English. 



Hhen participants have completed their translations, ask each one to compare 
his or her work with a partner. Use Overhead Transparency C: GLOOPY AND 
BUT and a blank overhead transparency overlay to review translations with 
the group. 



Ask a volunteer to share his or her translation with the group. 



• Record the translation on the blank overhead placed on top of 
Overhead Transparency C. 



Ask another volunteer for a different translation If someone has 
one . Use another bl ank transparency to record the second 
translation. 



Lead a discussion about the translations and the way In which the activity 
helps participants to revisit the reading process. Points should be made 
regarding the roles which background knowledge, language experience, and 
story sense contributed to the reader's ability to comprehend the story. 



Make note that background knowledge and language experience help us to 
comprehend statements like "BEGIN TO NEGOTIATE WITH KISSINGER IN ISRAEL 
TODAY 11 ; however, the story grammars we learn In our infancy help us know 
what to expect 1n most stories. 



Special note should be made of the translation of the word "jonfy". This 
word appears 1n the text as both a noun and a verb. In one instance, It 
follows the article "a", and 1n another 1t 1s part of an Infinitive. 



Conclude by reviewing the way In which the participants 1 experiences with 
the activity can be explained with reference to Goodman's model. Stress the 
Importance of using background knowledge and language experience in making 
predictions and confirming or dlsconflrmlng them In the comprehension 
process. Use this discussion as a lead Into the next activity during which 
the Importance of developing prereadlng and reader-text Interaction 
strategies will be stressed. 
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Activity 1.3 IMPLICATIONS FOR READING INSTRUCTION 



Use Overhead Transparencies D, E, F v and G to Introduce the upcoming 
workshops. 



As you review Overhead Transparency D: PREREADING STRATEGIES INSTRUCTION, 
be sure to point out that these strategies are related to Goodman's theory 
In that they: 



1. promote the reader's use of background knowledge and language 
experience: and 



2. encourage meaningful predictions prior to reading text. 



When reviewing Overhead Transparency E: READER-TEXT INTERACTION STRATEGIES 
INSTRUCTION, stress that these strategies: 



1. help the reader to confirm or dlsconflrm predictions; and 



2. develop the reader's self-questioning skill. 



As you review Overhead Transparency F: PURPOSES FOR EFFECTIVE QUESTIONING 
TECHNIQUES, discuss the Importance of developing effective questioning 
techniques for the purpose of Improving Instruction, as well as evaluation. 



Finally, as you review Overhead Transparency G: PURPOSES OF MATERIALS 
REVIEH, point out that careful review of Instructional materials Is 
essential for ensuring that students are provided with meaningful activities 
for developing and reinforcing Individual skills and learning how to read. 



Additional workshops can be planned to Introduce the instructional materials 
and activities presented In the forthcoming document, Booklet C: 
Strategies for Teaching the Skills . 
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CONCLUSION OF THE WORKSHOP 



Conclude the workshop by answering questions participants may have about the 
content of this workshop and the training sessions to come. Review the 
objectives and purposes of the sessions. If necessary. Rewind the group of 
the materials they should have with them at the next sessions: the 
Resource guide , the Teaching Strategies Series , Booklets A and 8, and a 
content-area textbook. 



Assign the FOLLOW-UP ACTIVITIES (page I B.6 In Horkshop Packet I ) to be 
completed by the next session. 
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TRAINING MATERIALS 
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MODULE I 



OVERHEAD TRANSPARENCY A 



OBJECTIVES FOR WORKSHOP I 



1 . TO BECOME FAMILIAR WITH A THEORY OF 
THE READING PROCESS. 



2. TO PREVIEW THE WORKSHOP SERIES. 
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MODULE I 



OVERHEAD TRANSPARENCY B 



THE GOODMAN MODEL 



AUTHOR 

1. THOUGHT 
Thinking Ability 
Concepts (Exper.) 

2. LANGUAGE 
Semantic System 
Syntactic " 

Phonological*' 



PRINTED 
MATERIAL 



T 



READER 

1 . THOUGHT 
Thinking Ability 
Concepts (Exper.) 

2. LANGUAGE 
Semantic System 
Syntactic M 
Phonological " 



READER 
SELECTS/PREDICTS 

1. Graphic Cues 

2. Language Cues 
Phonemic Cues 
Syntactic Cues 
Semantic Cues 



NO 
\ 



YES 



COMPREHENSION 
Integration 
into Memory 



READER TESTS 

1. Semantic 
Acceptability: 
Does it make 
sense? 

2. Syntactic 
Acceptability: 
Does it seem 
like language? 



Adapted from Kenneth 
Goodman's Model of 
Proficient Reading 
(Smith-Burke, 1973) 
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MODULE I 



OVERHEAD TRANSPARENCY C 



GLOOPY AND BLIT 

Gloopy is a borp. 

Blit is a lof. 

Gloopy klums like Blit. 

Gloopy and Blit are floms. 

Rill had poved Blit to a jonfy, but Lo 
had not poved Gloopy. 

"To jonfy is for lofs," Blit bafd to Gloopy. 

"Rom are a borp!" 
Gloopy was not klarpy. 
Then Blit was not klarpy. 

SMITH, F., GOODMAN, K., & MEREDITH, J. (1970) 
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MODULE I OVERHEAD TRANSPARENCY D 

PREREADING STRATEGIES 

INSTRUCTION 



PURPOSES: 



TO ENCOURAGE STUDENTS TO RECALL BACKGROUND 
KNOWLEDGE ABOUT AND EXPERIENCE WITH THE TOPiC 

TO FOSTER MEANINGFUL PREDICTIONS ABOUT WHAT 
THE AUTHOR MIGHT SAY REGARDING THE TOPIC 



3 J 
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MODULE I OVERHEAD TRANSPARENCY E 

READER -TEXT INTERACTION 
STRATEGIES INSTRUCTION 

PURPOSES: 



TO ENSURE THAT STUDENTS INQUIRE ABOUT 
WHAT THEY ARE READING WITH MEANINGFUL 
SELF-QUESTIONS 

TO PROMOTE STUDENTS* ACTIVE PARTICIPATION 
AND THINKING AS THEY READ 



( 



3 
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MODULE I 



OVERHEAD TRANSPARENCY F 



PURPOSES OF EFFECTIVE 

QUESTIONING 

• TO DEVELOP IN STUDENTS THE ABILITY TO 
SELF-QUESTION DURING READING. 

• TO ASSESS THE LEVEL OF STUDENTS' 
COMPREHENSION. 



• • • 

MODULE I OVERHEAD TRANSPARENCY G 



PURPOSES OF MATERIALS 

REVIEW 

• TO DETERMINE THE EFFECTIVENESS OF 
READING MATERIAL 

• TO ENSURE MEANINGFUL STUDENT ACTIVITY 
IN DEVELOPING READING SKILLS. 
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WORKSHOP PACKET I 
The Reading Process 
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TABLE OF CONTENTS 

Paae 

Introduction I B.3 

Workshop Objectives I b.3 

Activities and Worksheets I B.4 

Bibliography and References I b.8 
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INTRODUCTION 



I B.3 



A good deal of research has been conducted during the last two decades in an 
effort to understand the complex nature of the reading process. Researchers 
also have Investigated the relative effectiveness of a variety of teaching 
strategies designed to Improve students 1 reading comprehension. 

Although a number of models representing the reading process have been 
proposed by different experts In the field, there Is general consensus about 
what constitutes proficient reading. The proficient reader Is one who Is 
Involved actively In an ongoing effort to comprehend text* This active 
Involvement requires the reader to use particular strategies and skills In 
order to grasp an author's meaning* Readers who make use of their 
background knowledge and their experience with language read with greater 
comprehension than those who do not* Readers who make meaningful 
predictions about what an author will say about a topic and those who 
question the meaning of the author's message as they read comprehend better 
than those who don't. 

These findings have significant Implications for the teacher of reading. 
Strategies designed to stimulate the use of background knowledge - and 
language experience, to motivate the self-questioning necessary for ongoing 
comprehension, and to encourage active Interaction with the author's word 
need to be taught In the classroom* Further, materials designed to teach 
and/or reinforce the component skills of reading need to be examined 
carefully to ensure that they do, In fact, accomplish these goals. 

It Is to this end that these teacher-training sessions have been designed. 
The Introductory workshop familiarizes you with the theoretical basis for 
the teaching strategies presented In subsequent sessions. It Is Important 
that, during the course of Instruction in specific teaching techniques, 
evaluation practices, and materials review, you remember the concept of the 
reading process upon which they are based. Hhen you have exhausted practice 
of the activities presented here, we would like you to be able to design 
your own* This can be accomplished best by understanding the theoretical 
framework for reading presented here. 



WORKSHOP OBJECTIVES 



1. To become familiar with the theoretical framework for the training 
sessions. 

2. To preview the workshop series. 



ACTIVITY 1.1 



THE GOODMAN MODEL 



AUTHOR 

1 . THOUGHT 
Thinking Ability 
Concepts (Exper.) 

2. LANGUAGE 
Semantic System 
Syntactic " 
Phonological " 



PRINTED 
MATERIAL 



r 



READER 
SELECTS/PREDICTS 

1. Graphic Cues 

2. Language Cues 
Phonemic Cues 
Syntactic Cues 
Semantic Cues 



READER 

1 . THOUGHT 
Thinking Ability 
Concepts (Exper.) 

2. LANGUAGE 
Semantic System 
Syntactic 
Phonological 



»» 
»» 



NO 



YES 



COMPREHENSION 
Integration 
into Memory 



READER TESTS 

1. Semantic 
Acceptability: 
Does it make 
sense? 

2. Syntactic 
Acceptability: 
Does it seem 
like language? 



Adapted from Kenneth 
Goodman's Model of 
Proficient Reading 
Smith-Burke 
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ACTIVITY 1.2 

GLOOPY AND BLIT 



Gloopy is a borp. 

Blit is a lof. 

Gloopy klums like Blit. 

Gloopy and Blit are floms. 

Rill had poved Blit to a jonfy, but Lo 
had not poved Gloopy. 

"To jonfy is for lofs/' Blit bafd to Gloopy. 

"Rom are a borp!" 
Gloopy was not klarpy. 
Then Blit was not klarpy. 

SMITH, F., GOODMAN, K., & MEREDITH, J. (1970) 
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FOLLOH-UP ACTIVITIES FOR WORKSHOP I 



Select an article from a journal or magazine on a topic which Is 
somewhat foreign to you. The article should be on something about 
which you have some prerequisite background knowledge, but which may 
present unfamiliar concepts. Record your experiences while reading. 
Try to make note of strategies you use to "crack the code" when you are 
having difficulty reading. 



Select a one-paragraph passage which you can place on an overhead 
projector. Display the paragraph one sentence at a time. Ask students 
to read the first sentence, and then have a volunteer explain what his 
or her thoughts are about the meaning of the passage. Continue in this 
fashion until the paragraph Is complete, encouraging students to 
verbalize as much as they can about their thinking processes as they 
read. Conclude the session with a discussion about the whole 
activity. Try to elicit students' awareness of the reading process as 
we discussed It during the first workshop. 



Choose a student to read a five- to six-paragraph passage on a topic 
familiar but somewhat new to the student. Sit with the student as he 
or she reads the passage aloud. Ask the student to verbalize how he or 
she makes sense of those parts of the passage that are difficult to 
comprehend. Record these verbalizations and any observations you have 
about strategies the student uses to understand the passage. 
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Ask students to bring In headlines which Include potential mlscues, 
such as the ones presented In this workshop (e.g., "PRINCE ABDUL 
MARRIES PRINCESS AMID POMP.") 



Use "Gloopy and Bllt" with your students to help them become aware of 
what they do when they read. 



Read pages 51-59 In the Resource Guide to prepare for the next 
session. 
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NODDLE II: QUESTIONING TECHNIQUES 
Workshop Presenter's Guide 



II A. 3 
OVERVIEW OF MODULE II 



WORKSHOP OBJECTIVES: 

1. To become familiar with effective questioning systems. 

2. To practice application of questioning techniques. 

3. To understand the purposes for learning questioning systems. 

4. To review tips for effective questioning. 



TRAINING MATERIALS: 



Improving Studenf ' AbllitUj to Read and Think: A Resource Guide 



Workshop Packet II 






Overhead Transparency 


A: 


OBJECTIVES FOR WORKSHOP II 


Overhead Transparency 


B: 


PURPOSES OF EFFECTIVE QUESTIONING 


Overhead Transparency 


C: 


CHRISTENBURY AND KELLY 


Overhead Transparency 


D: 


THE QUESTIONING CIRCLE 


Overhead Transparency 


E: 


GALLAGHER AND ASCHNER 


Overhead Transpirency 


F: 


PEARSON AND JOHNSON 


Overhead Transparency 


G: 


SANDERS 


Overhead Transparency 


H: 


TABA 


Overhead Transparency 


I: 


QUESTIONING TIPS 



Blank overhead transparencies and pen 
Newsprint, magic markers, and masking tape 

PREPARATION SUGGESTIONS: 

• Review the five questioning systems presented 1n the Resource Guide . 

• Read the procedures, and anticipate questions that may be asked by the 
participants. 

• Prepare the overhead transparencies. 



II A.S 

PROCEDURES FOR MODULE 1 1 



INTRODUCTION 



Review the follow-up activity for Horkshop I, using the guidelines provided 
below. Reinforce Icteas discussed during the first workshops, and answer 
questions that participants may have thought of since the last session. 

Use Overhead Transparencies A and B to present the objectives and purposes 
for this module. Point out that, although there are a number of questioning 
systems to develop questioning skills, only five systems will be discussed 
here. Participants will practice using each system to Improve both the 
teaching and the evaluation of reading comprehension. In addition, 
questioning tips applicable to all five systems will be presented. 

You should consider presenting the materials In this module In more than one 
workshop session since the Information covered Is rather lengthy . Careful 
thought and time are required for learning the theoretical framework and 
practical application of each of the questioning systems. Therefore, you 
might consider presenting Activities II. 1, II. 2, and II. 3 In one session and 
Activities II. 4, II. 5, and II. 8 In another. Or, you might consider 
presenting only those systems with which you feel most comfortable. 
Nhatever your choice, keep In mind that "more may be less" If you present 
too much Information at one time. 

The questioning strategies presented In this manual provide teachers with 
alternate methods for eliciting Insights from students. These methods also 
may be used to assess level of student understanding so that teaching may be 
adjusted accordingly. 

It Is Important to stress that the use of effective questioning techniques 
Improves the teaching, as well as the evaluation of reading. Students learn 
to be Independent and proficient readers when they have been given the 
opportunity to understand for themselves the paths and the barriers to 
comprehension. Teaching students to ask meaningful questions as they read 
on their own can afford them this opportunity. 



REVIEW OF FOLLOW-UP ACTIVITIES FOR WORKSHOP I: THE READING PROCESS 



Use a blank overhead transparency to record observations about the follow-up 
activities for Workshop I. 

Ask participants to discuss their experiences during the follow-up 
activities and the theory, research, and strategies reviewed In Horkshop I. 



53 



ACTIVITIES 
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Activity II. 1 CHRISTENBURY AND KELLY 



An explanation of Chrlstenbury and Kelly's system of questioning may be 
found on pages 51-53 of the Resource Guide . Introduce this questioning 
system with the use of Overhead Transparency C: CHRISTENBURY AND KELLY. 
Review the three sources of knowledge upon which this system is based, and 
discuss the nature of "white", "shaded", and "dense" questions. 



• Ask participants to read the passage entitled "PINE BARRENS," 
which appears on page II B.4 In Workshop Packet II . 



Have them design three "white" questions for the massage. Tell 
them to use the Activity II. 1 QUESTION SHEET on page II B.5 in 
their packets. 



Ask volunteers to share their questions with the group. Record 
the sample questions on the board. 



Have each volunteer justify his or her sample question. 



Divide the participants into groups of three or four. Ask them to formulate 
three "shaded" questions for the passage. 



Have each group write its questions on newsprint and display the 
questions by taping the newsprint on the walls. 



Ask a representative from each group to provide a rationale for 
why the questions posed can be considered "shaded" questions. 



Follow the same procedure for formulating one "dense" question. 



Be sure the groups do not design "shaded" and "dense" questions at the same 
time. It is important that teachers understand the distinctions amr^cj the 
three separate question types. This understanding develops best if 
participants address the question types separately at first. 



Use Overhead Transparency D: THE QUESTIONING CIRCLE to illustrate the 
distinctions and the interrelationships among the three question types. As>x 
participants to review the sample questions for this passage which appear in 
Workshop Packet II (page II B.6). (The questions also can be found on 
page 53 in the Resource Guide .) 
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Activity 11,2 GALLAGHER ANO ASCHNER 



An explanation of Gallagher and Aschner's questioning system may be found on 
page 54 cf the Resource Guide . Use Overhead Transparency E: GALLAGHER AND 
ASCHNER to Introduce this questioning system. 



• Divide the whole group Into groups of four or five. 



Assign a different questioning level (I.e., cognition-memory, 
convergent thinking, divergent thinking, and evaluative thinking) 
to each group. Leave the overhead on for participants to use as a 
resource. Make sure they do not refer to the sample questions In 
their packets until the activity has been completed. 



Ask each group to compose four to five questions at the level 
assigned for the passage entitled "PINE BARRENS" (found on page II 
B.4 of Workshop Packet II ). 



Hhen each of the groups has completed the questions, ask the groups to 
select two of their best questions to record on newsprint and display on the 
wall. 



• Havi a representative frora each group explain how the questions 
represent the assigned level. 



• Ask the participant-audience to critique the explanations, making 
recommendations when necessary. 



Ask participants to review the sample questions for this passage which 
appear on page II B.8 1n Workshop Packet II . (The questions also can be 
found on page 54 of the Resource Guide .) 
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Activity II. 3* PEARSON AND JOHNSON 

An explanation of Pearson and Johnson's system of questioning may be found 
on pages 55-56 of the gtjource Guide . Present the following set of 
questions, which appears In Workshop Packet II (page II B.9). (See 
alternate Activity II. 3b If you find these queslons to be unsuitable). 

1. Name the color of one dress Alexis wore on the last episode which 
you saw of "Dynasty". 

2. Hhy Is Blake so concerned about Stephen's love life? 

3. How Is the life the Carrlngtons live different from your life? 

4. Hhy did Alexis say nasty things about Crystal In the last episode? 

5. In which part of the country does "Dynasty" take place? 

6. Hho Is your favorite character on the show? Hhy? 

Divide the participants Into groups of three or four. (Be sure at least one 
member of each group Is a "Dynasty" viewer!) 

• Ask the groups to answer the questions. Tell them to be prepared 
to Justify their answers. 

• Review the answers with the group, making sure each person who 
volunteers an answer provides a justification for It. 

Use Overhead Transparency F: PEARSON AND JOHNSON to review their 
questioning system. 

• Ask each of the groups to label the questions according to Pearson 
and Johnson's system. Leave the overhead on as a resource for 
participants. 

• Review the question labels with the group ensuring that each 
volunteer provides a rationale for the label assigned to each 
question. 

Be sure to discuss Pearson and Johnson's notion that a response to a 
question may Indicate a need to reconsider the label for that question. For 
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example. If "Colorado" Is given as an answer to question 5, It suggests that 
the reader has taken one more logical step from the text than the reader who 
gives "Denver" as an answer. Thus, the question night be considered a 
"textually Implicit" one for the latter respondent and a "textually 
explicit" one for the former respondent. 



Similarly, If someone cites an exact cause of Alexis' nasty statement about 
Crystal, question 4 could be labeled textually Implicit. If, on the other 
hand, the answer given Is a statement concerning stereotypical notions about 
the relationship between wives and ex-wives, question 4 could be considered 
a "scrlptally implicit" one. 



Conclude with a discussion of the examples for Pearson and Johnson's 
questioning system based on the "PINE BARRENS" passage. (The passage 
appears on page II B.4 In Workshop Packet II : the examples appear on page II 
B.11 In Workshop Packet II and on page 55 In the jjtjourct Ouldm.) 
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Activity 11.3b PEARSON AND JOHNSON (Alternate) 



Present the following set of questions, which appear 1n Workshop Packet II 
on page II 6.10. 



1. What 1s Hamlet's mother's name? 

2. Why Is Hamlet so concerned about his mother's love life? 



3. In what ways do people of Hamlet's time Interact differently from 
the ways 1ii which we Interact? 



4. Why does Hamlet feel so much anger toward his uncle? 



5. Where does Hamlet take place? 



6. Who Is your favorite character 1n the play? Why? 



Divide the participants Into groups of three or four. 



• Ask the groups to answer the questions. Tell them to be prepared 
to justify their answers. 



• Review the answers with the whole group, making sure each person 
who volunteers an answer provides a justification for 1t. 



Use Overhead Transparency F: PEARSON AND JOHNSON to review their 
questioning system. 



• Ask each of the groups to label the questions according to Pearson 
and Johnson's system. Leave the overhead on as a resource for 
participants. 



• Review the question labels with the whole group ensuring that each 
volunteer provides a rationale for the label assigned to each 
question. 



Be sure to discuss P- irson and Johnson's notion that a response to a 

question may Indicate a .teed to reconsider the label for that question. For 

example, If "Scandinavia" Is given as an answer to question 5, It suggests 

that the reader has taken one more logical step from the text than the 
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reader who gives "Denmark" as an answer. Thus, the question might be 
considered a "textuaily Implicit" one for the latter respondent and a 
"textual 1y explicit" one for the former respondent. 

Similarly, if someone specifies particular lines or a particular scene from 
the play which explains Hamlet's anger toward his uncle, question 4 could be 
labeled "textuaily Implicit." If, on the other hand, the answer given Is 
based on general notions of the Oedlpal complex, question 4 could be 
considered a "'scrlptally' Implicit" one. 

Conclude with a discussion of the examples for Pearson and Johnson's 
questioning system based on the "PINE BARRENS" passage. (The passage 
appears on page II B.4 In Works ..op Packet II ; the examples appear on page II 
B.11 In Workshop Packet II and on page 55 In the Resource Guide .) 
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Activity II. 4 SANDERS 



An explanation of the questioning system developed by Sanders may be found 
on pages 56-58 of the Resource Guide. 



Use Overhead Transparency G: SANDERS to Introduce participants to this 
questioning system. Point out that Sanders based his system on Bloom's 
Taxonomy of Educational Objectives (reprinted as Appendix C, pages 181-83, 
of the Resource Guide). 



Review the question types specified by Sanders. 



Ask, participants to compose one question for each question type, 
using a story with which they are familiar. Suggest that they 
work 1n pairs If they wish. Leave the overhead on as a resource 
for participants. Be sure they do not refer to the sample 
questions In their packets until the activity has been completed. 



Ask two volunteers to put their questions on the board and to 
provide a rationale for each. 



Refer the participants to Workshop Packet II (page II B.12) for examples of 
questions based on this system for the passage entitled "PINE BARRENS." 
(These examples also can be found on pages 56-58 of the Resource Guide.) 
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Activity II. 5 TABA 



An explanation of Taba's questioning system may be found on pages 58-59 of 
the Resource Guide. 



Use Overhead Transparency H: TABA and Horkshop Packet II (pages II B. 13-14) 
to review Taba's questioning system. 



• First review the hierarchy developed by Taba as Illustrated on the 
Overhead Transparency. 



• Then, review the examples based on the "PINE BARRENS" passage 
which appears 1n the Horkshop Packet . 



Discuss any questions participants may have about this system. Have them 
practice using Taba's system by applying the questioning system to the 
passage entitled "EARTHQUAKES," which appears on page II B.15 In the 
Workshop Packet. 



• Ask each participant to compose a question for at least two levels 
Included within the three Cognitive Tasks described by Taba. Ask 
them to use Activity II. 5 QUESTION SHEET on page II B.16 1n their 
packets. 



Use a blank overhead transparency to record and display two 
examples of each of the three Cognitive Tasks. 
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Activity II. 6 QUESTIONING TIPS 



Use the CHRISTENBURY AND KELLY questions designed for the "PINE BARRENS" 
passage to conduct this activity. (These questions are listed on page 53 of 
the Resource Guide , as well as on page II B.6 of Workshop Packet II ). 



Ask the participants questions. Do not pause more than threy 
seconds between each question. 



Hhen participants fall to answer within the three-second time 
span, repeat the question two more times. 



Call on only those same two or three people who answer the first 
few questions when you ask subsequent questions. 



Stop after asking the first five questions. 



Have participants work; 1n pairs to analyze problems with the activity. 



Ask them what went wrong with the questioning session. 



Use Overhead Transparency I: QUESTIONING TIPS to discuss 
Important points about effective questioning procedures. (These 
questioning tips also may be found on page II B.17 of Workshop 
Packet II). 
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CONCLUSION OF THE WORKSHOP 



Answer any questions participants may have about the questioning systems. 
Assure them that they need not be familiar with the details of each of the 
systems , but that they should have an awareness of the variety of systems 
they can use. Suggest to participants that they familiarize themselves with 
one or two of the systems as a basis for questioning. 

Point out that the questioning systems discussed here can be taught to 
students, as well . These systems should be taught to students since 
students need to develop good self-questioning techniques for use during 
reading. Once students have learned the theoretical framework and question 
format for one or more of these systems, they can apply them during 
reader-text Interaction. 



Assign the FOLLOW-UP ACTIVITY which can be found on page II 0.18 In Workshop 
Packet II. 
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TRAINING MATERIALS 



2885^ 

64 



OVERHEAD TRANSPARENCY A 



OBJECTIVES FOR 
WORKSHOP II 

1 . TO BECOME FAMILIAR WITH EFFECTIVE 
QUESTIONING SYSTEMS. 

2. TO PRACTICE APPLICATION OF QUESTIONING 
TECHNIQUES. 

3. TO UNDERSTAND THE PURPOSES FOR LEARNING 
QUESTIONING SYSTEMS. 

4. TO REVIEW TIPS FOR EFFECTIVE QUESTIONING. 



MODULE II 



OVERHEAD TRANSPARENCY B 



PURPOSES OF EFFECTIVE 

QUESTIONING 

• TO DEVELOP IN STUDENTS THE ABILITY 
TO SELF-QUESTION DURING READING. 

• TO ASSESS THE LEVEL OF STUDENTS' 
COMPREHENSION. 
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OVERHEAD TRANSPARENCY C 



CHRISTENBURY AND KELLY 

"WHITE" QUESTIONS (one source) 

1 . THE MATTER 

2. PERSONAL REALITY 

3. EXTERNAL REALITY 

"SHADED" QUESTIONS (two sources) 

1 . THE MATTER/PERSONAL REALITY 

2. THE MATTER/EXTERNAL REALITY 

3. PERSONAL REALITY/EXTERNAL REALITY 

"DENSE" QUESTIONS (three sources) 

1 . THE MATTER/PERSONAL REALITY/EXTERNAL REALITY 
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OVERHEAD TRANSPARENCY D 



THE QUESTIONING CIRCLE 




REPRINTED WITH PERMISSION OF THE NATIONAL COUNCIL OF TEACHERS OF ENGLISH 

(CHRISTENBURY k KELLY, 1983, p. 13) 
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OVERHEAD TRANSPARENCY E 



GALLAGHER AND ASCHNER 

COGNITION MEMORY (Recognition, Rote Memory, Recall) 

CONVERGENT THINKING (Analysis Expected Outcomes) 

DIVERGENT THINKING (Analysis Novel Outcomes) 

EVALUATIVE THINKING (Making a Judgment or 

Selecting an Option) 
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OVERHEAD TRANSPARENCY F 



PEARSON AND JOHNSON 



TEXTUALLY EXPLICIT 
("Right There") 

TEXTUALLY IMPLICIT 
("Think and Search") 

"SCRIPTALLY" IMPLICIT 
("On My Own") 
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M0DULE 11 OVERHEAD TRANSPARENCY G 



SANDERS 



MEMORY 



TRANSLATION 



INTERPRETATION 



APPLICATION 



ANALYSIS 



SYNTHESIS 

77 EVALUATION 78 



MODULE II OVERHEAD TRANSPARENCY H 

TAB A 

COGNITIVE TASK I: CONCEPT DEVELOPMENT 

List 
Group 
Label 
Subsume 
Make Multiple Classifications 

COGNITIVE TASK II: INTERPRETATION OF DATA 

Recall Concepts 
Compare and Contrast 
Generalize 
Verify 

COGNITIVE TASK III: APPLICATION OF PRINCIPLES 

Make Predictions 
Support or Explain 
79 Make Wider Predictions 80 
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OVERHEAD TRANSPARENCY I 

QUESTIONING TIPS 

1 . ALLOW STUDENTS AT LEAST FIVE SECONDS TO RESPOND 
TO A QUESTION YOU ASK. 

2. BE SURE TO CALL ON A GOOD CROSS-SECTION OF 
STUDENTS. 

3. WHEN STUDENTS FAIL TO UNDERSTAND A QUESTION, PARA- 
PHRASE IT AT LEAST ONE, BUT NO MORE THAN TWO, TIMES. 

4. DO NOT "BOMBARD" STUDENTS WITH TWO OR THREE 
QUESTIONS AT A TIME. 

5. BE CLEAR ABOUT YOUR PURPOSE IN ASKING A QUESTION, 
AND TELL STUDENTS WHAT THAT PURPOSE IS. 

6. POSE QUESTIONS CLEARLY AND SUCCINCTLY. 

7. DO NOT ASK QUESTIONS ABOUT E VERYTHING STUDENTS 
READ. 
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WORKSHOP PACKET II 
Quest ioniig Techniques 
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TABLE OF CONTENTS 

Page 

Introduction II 3.3 

Workshop Objectives II b.3 

Activities and Worksheets II b.4 

Bibliography II b.19 
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INTRODUCTION 
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One of the most valuable skills a teacher can possess Is the art of asking 
effective questions. The ultimate goal c? Instruction Is to nurture 
students who will be able to accomplish on their own what they have achieved 
with proficiency under our tutelage. The proficient, Independent reader Is 
one who can ask him- or herself the questions good readers ask themselves 
while reading. This can be achieved If we model not only what those good 
questions are, but how and when to pose thorn. 

The five different questioning systems presented here offer teachers 
alternative means for developing the art of effective questioning. Though 
all these systems share the goal of developing students' high-order 
self-questioning and thinking, each system offers teachers a distinctive 
approach to this goal. He, therefore, recommend that teachers determine, 
during the course of this session, that system or combination of systems 
with which 'hey are most comfortable and with which their students will have 
most success. 

Please note that the descriptions and sample auestlons for the "PINE 
BARRENS" passage used In this packet have been written by Paul Cohen and 
Tynette Hills, principal authors of the Resource Guide. 



WORKSHOP OBJECTIVES 

1. To become familiar with effective questioning systems. 

2. To practice application of questioning systems. 

3. To understand the purposes of learning questioning systems. 

4. To review tips for effective questioning. 
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PINE BARRENS 



I met Harry, a native of New Jersey, while we were studying law in 
Boston. His mellow, sophisticated charm was as comfortable as a 
fireplace, and he knew that fascinating city's historical sites and 
restaurants well enough to be a tour guide. Periodically, I'd say, "Let's 
stay here and practice law together. 4 ' Then Harry would get a homesick 
look and change the subject. Finally, one day, Harry suggested that we 
visit the New Jersey area where he intended to practice law. 

Since I expected to see a tightly packed urban area . I was astonished 
when, after several hours of driving, we parked by an abandoned railroad 
track, walked for about 15 minutes, and were in a world peopled by 
toads, turtles, buzzards, skunks, and snakes. 'The Pine Barrens," Harry 
explained, "is it wilderness area covering over 2,000 square miles of this 
area of New Je^ey." He named each bird and plant we saw -including 
th* threadleaf sundew, Which traps and eats insects. He said the Barrens 
contained 80 bird species and many species of reptiles and amphibians. 
The land was rich with vegetation -anything but barren. 

Later, he talked quietly but intensely shout the area's endangered 
species, inciuding the Pine Barrens tree frogs I could hear in the cedar, 
oak, and pine forest outside. I now understood why Harry had never 
seriously considered settling in Boston. His beautifully natural, 
uncrowded place was just a few hours from the large cities that make 
New Jersey the most densely populated state in the Union. "It is also the 
site of new communities," Harry said seriously. "I can understand why 
people want to live here, and it belongs to us all. But I want to help 
assure that the new development doesn't destroy what we all come here 
to enjoy." 
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Activity II. 1 QUESTION SHEET CHRISTENBURY AND KELLY 

"Hhlte" questions 

1. 

2. 

3. 



"Shaded" questions 

1. 

2. 

3. 



"Dense" question 

1. 
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CHRISTENBURY AND KELLY 

Review these question types and samples as your trainer reviews them on the 
overhead transparency. 



"HHITE" QUESTIONS (those related to one source of information) 

1. The Matter; Why was Harry's friend surprised to see where Harry wanted 
to practice law? J 

2. Personal Reality; Would you like to live near the Pine Barrens? 

3. External Reality; How do people irr the United States feel about 
Developing areas like the Pine Barrens? 



"SHADED" QUESTIONS (those related to two overlapping sources of Information) 

1 - |he Matter/Personal Reality; Under what circumstances would you live 
in an area like the Pine Barrens? 

2- The Matter/External Reality; What are the environmental Issues and 
laws of New .lersey for developing the Pine Barrens area? 

3. Personal Real Itv/External Reality: what do you feel are the problems 
in the development of new communities In the Pine Barrens area or other 
wilderness areas? 



'DENSE" QUESTION (those related to all three overlapping sources) 



1. The Matter/Person? i Reality/External Reality : How do you think most 

p ??5 ?, fee1 about devel °Plng residential communities In our remaining 
wildlife areas? * 
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THE QUESTIONING CIRCLE 




REPRINTED WITH PERMISSION OF THE NATIONAL COUNCIL OF TEACHERS OF ENGLISH 

(CHRISTENBURY & KELLY, 1983, p. 13) 
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Activity II. 2 GALLAGHER AND ASCHNER 
Compare these sample questions with your own. 

Questions for Cognition-Memory (Requiring recognition, rote memory, and 
selective recall In order to reproduce facts, Information, and the like) 

1. Who are the main characters In the story? 

2. Where does Harry Intend to practice law? 

3. How large Is the area of the Pine Barrens? 

Convergent Thinking (Requiring analysis of Information so that a tightly 
structured framework of Information and questions leads to an expected 
outcome) 

1. Retell the story In your own words. 

2. Why didn't Harry want to settle In Boston? 

3. Why Is Harry concerned about new development near the Pine Barrens? 

4. What would be necessary to save the Pine Barrens from developers? 

5. What changes may occur as development progresses? 

6. What would result If development went too far? 

Divergent Thinking (Requiring analysis of Information so as to produce a 
novel or different outcome resulting from the student's own point of view) 

1. What laws could you propose to protect the P1ne Barrens? 

2. What should be done to protect the environment and to develop new 
communities In the future? Why? 

3. How would Harry have felt about the development of the Meadowlands? 

Evaluative Thinking (Requiring that students make a judgment, select an 
option, and/or assign a value) 

1. Do you think Harry's concern for the environment Is justified? Why? 

2. Do you think that progress of this kind Is good? Why? 
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Activity II. 3& PEARSON AND JOHNSON 

Answer the following set of questions: 

1. Name the color of one dress Alexis wore on the last episode which you 
saw of "Dynasty". 

2. Why Is Blake so concerned about Stephen's love life? 

3. How Is the life the Carrlngtons live different fron? your life? 

4. Why did Alexis say nasty things about Crystal 1n the last episode? 

5. In which part of th« country does "Dynasty" take place? 

6. Who Is your favorite character on the show? Why? 
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Activity II. 3b PEARSON AND JOHNSON (Alternate) 
Answer the following set of questions: 

1. Hhat 1s Hamlet's mother's name? 

2. Hhy Is Hamlet so concerned about his mother's love life? 

3. In what ways do people of Hamlet's time Interact differently than we do? 

4. Hhy does Hamlet feel so much anger toward his uncle? 

5. Where does Hamlet take place? 

6. Hho Is your favorite character 1n the play? Why? 
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Activity II. 3c PEARSON AND JOHNSON 

Review the sample questions about the "PINE BARRENS" below, and compare them 
with your own. 

Textual 1y Explicit ("Right There": The question and the answer may be found 
In the text directly.) 

1. Who are the main characters In the passage? 

2. How large Is the Pine Barrens area? 



Textual 1v Implicit ("Think ani Search": The question and answer are derived 
from the text, but at least one step of logical reasoning or Inferring Is 
necessary to arrive at an answer.) 

1. Where does Harry's friend want to practice law? 

2. Why didn't Harry want to practice law In Boston? 



"Scrlptally" Implicit Questions ("On My Own": The question Is related to 
the text, but the reader must Infer the answer from prior knowledge combined 
with the text Information.) 

1. Why Is Harry concerned about new development near the Pine Barrens? 

2. How Is Boston different from the Pine Barrens? 



ERIC 



94 



Activity II. 4 SANDERS 
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Review the sample questions, and compare them with your own. 



Memory Questions (Calling for recognition or recall of information) 

1. Hho are the main characters In the story? 

2. Where does Harry intend to practice law? 



Translation Questions (Calling for changing a communication to a parallel 
form) 

1. Retell the story In your own words. 



Interpretation Questions (Calling for relating facts, generalizations, 
definitions, values, and skills) 

1. Why didn't Harry want to settle In Boston? 

2. Why Is Harry concerned about new development near the Pine Barrens? 



Application Questions (Calling for transfer of knowledge to new or different 
situations) 

1. From what you know about Harry, explain how he would feel about 
practicing law In Atlantic City. 

2. What would result If development went too far In the Pine Barrens? 



Analysis Questions (Requiring the student to solve a problem by consciously 
using knowledge of parts and processes of reasoning) 

1. What are the author's opinions about Harry In this passage? 

2. What reasons might people give for wanting to live near the Pine 
Barrens? 



Synthesis Questions (Involving creative thinking, made possible by a 
classroom atmosphere In which divergent opinions are accepted and welcomed) 

1. What laws could you propose to protect the P1ne Barrens? 

2. How do you think Harry would have felt about the development of the 
Neadowlands? 



Evaluative Questions (Calling for students to m*«r* a judgment based on use 
of Implicit or explicit criteria) 

1. Do you think Harry's concern for the environment Is justified? 

2. Do you think that progress of the kind taking place In the Pine 
Barrens Is good? Why? 
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Review the question types and samples below with your trainer. 



Cognitive Task I. Concept Development (Requiring differentiating, 
Identifying common properties, and determining order) 

1. List — Hhat can you tell me about New Jersey? 

2. Group — Hhat facts seem to belong together? On what basis? 

3. Label — Hhat would you call each of these groups? 

4. Subsume — Are there other Items that could go Into these groups? 

5. Multiple-Classification — Are there any Items that can go Into more 
than one group? 



Cognitive Task II. Interpretation of Data (Requiring differentiating 
between relevant and Irrelevant, Inferring cause and effect relationships, 
and generalizing and Inferring Implications) 

1. Recall the Concepts — Hhat did you notlct about the two places, 
Boston and the Pine Barrens? 

2. Compare and Contrast — Describe the similarities and differences 
between the two. 

3. Generali ze — How do you account for these differences? 

4. Verification — Can you think of other Illustrations of how 
development affects environments? 



Cognitive Task III. Application of Principles (Requiring analyzing, 
determining causal links, and reasoning logically) 

1. Making Predictions — If new communities were developed In the Pine 
Barrens, what do you think would probably happen? 

Can someone give a different prediction? (This question Is designed 
to encourage divergent thinking.) 

2. Support or Explain Predictions — Hhat makes you think that would 
happen? 

Hhat (conditions) would It take for that to happen? 
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